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A METHOD FOR TRACKING THE DISAPPEARANCE OF DETECTED LOGOS 
WITHIN DIGITAL VIDEO SIGNALS 

By 

SHAN LIU 
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Field of the Invention 

The present invention relates to the field of digital 
video display, and more particularly, to a method for 
tracking the display and disappearance of detected logos. 

Background of the Invention 

Increasingly, television broadcast signals include 
logos that are displayed on television screens over the 
broadcast programs as station identification. Typically, 
logos stay on the screen for considerably long periods of 
time without change in their intensities, colors, patterns 
and locations, etc. Hence, they may be annoying, and can 
cause problems such as the well-known screen burn on High 
Definition TV (HDTV) sets. As such, techniques have been 
developed for detecting the logos within the broadcast 
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video signals, and removing or processing the logos to 
avoid the above problems. 

On the other hand, the logos may disappear in some 
cases such as when the video programs change. Without 
promptly detecting the disappearance of the logo, and 
therefore stopping processing, annoying visual artifacts 
may result. Therefore, it is important to sense when the 
detected logo has disappeared. To that end, the pixel 
intensity value change has been examined to detect the 
fading of images in video signals, such as in U.S. patents: 
6,542,544; 6,084,641 and 5,245,436. 

In U.S. patent 5,245,436, the pixel means of a frame 
and its previous frames are calculated and then the 
relative mean change between the means is determined to 
detect the fading of an image. Although the mean change 
can be extensively applied to detecting the 

fading/disappearance of a logo, such a method is not robust 
when the video signal contains noise. As such, more 
comprehensive measurements must be undertaken. Similarly, 
U.S. patents 6,542,544 and 6,084,641 present different 
approaches to detecting fading of images in video signals. 
However, neither considers the impact of noise. 
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Indeed, almost all video signals in the real-world 
applications contain noise (some at considerably high 
levels) . There is, therefore, a need for a method and 
system for tracking and detecting the disappearance of 
logos within noisy video signals. 

Brief Summary of the Invention 

The present invention addresses the above needs. In one 
embodiment the present invention provides a method of 
detecting fade in an area of each of a sequence of frames 
comprising pixels that represent digital video images. The 
method includes the steps of: calculating a stochastic 
measure a d of said area based on the standard deviation of 
differences in pixel values in at least two of said frames; 
and detecting fade in said area by comparing the stochastic 
measure a d with a given noise level, such that if the 
difference between a d and the noise level is greater than a 
threshold value then fade is detected. 

Calculating the stochastic measurement a d can further 
include the steps of: (a) for each pixel in the current 
frame: (i) determining if the pixel belongs to logo area; 
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(ii) if so, calculating the difference between the value of 
the current pixel and that of a corresponding pixel in a 
reference frame; (iii) subtracting the give noise mean from 
the said difference , and squaring the obtained value; and 
5 (iv) generating a sum of the values obtained from (iii) for 
each of a plurality of said logo pixels; and then, (b) 
generating an average of the sum, and determining the 
stochastic measure a d based on said average. 

1° In above step (i), the method further includes the 

steps of initially detecting the logo area, and generating 
a map including a pixel pattern corresponding to the video 
frame, wherein each pixel in the pattern indicates whether 
the corresponding pixel in the video frame belongs to part 

15 of the logo or not. That map is used to select pixels of 
the video frame that are in the sub-image (i.e. logo) for 
processing as detailed above. 

In another aspect the present invention provides a 
20 fade detection system for detecting fade in a logo in each 
of a sequence of frames, comprising: a detector for 
detecting the logo in a video frame; a logo map generator 
generating a map including a pixel pattern corresponding to 
the video frame, wherein each pixel in the pattern 
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indicates whether the corresponding pixel in the video 
frame is in the logo; a logo tracker that detects logo fade 
by: using the map to select pixels of the video frame that 
are in the logo to, determine the difference between the 
value of the current pixel and that of a corresponding 
pixel in a reference frame, subtracting give noise mean 
from the difference and squaring the obtained value, and 
generate a sum of the squared said differences with noise 
mean subtracted for each of a plurality of logo pixels; 
generating an average of the sums; and comparing said 
average to a given noise level, such that if the difference 
between the said average and the noise level is greater 
than a threshold value then fade is detected. 

Other objects, features and advantages of the present 
invention will be apparent from the following specification 
taken in conjunction with the following drawings. 

Brief Description of the Drawings 

FIG. 1 is a diagramatrc illustration of an example 
process of detecting and tracking logos during the playing 
of video programs, according to an embodiment of the 
present invention; 
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FIG. 2 shows an example flow chart of the steps of 
detecting and tracking logos within digital video program 
according to the present invention; 

FIG. 3 shows a logo map by an example; 
5 FIG. 4 shows an example flow chart of a method of 

tracking a previously detected logo according to the 
present invention; and 

FIG. 5 shows an example block diagram of an embodiment 
of a logo detection and system according to the present 
0 invention. 

Detailed Description of the Invention 

As noted, because long time staying sub-images such as 
logos may cause problems such as screen burn on HDTV 

5 screens, it is highly desirable to detect and process the 
logos to prevent such problems. However, without prompt 
sensing of a logo' s disappearance and ceasing processing of 
the detected logo area, annoying visual artifacts may 
occur. Hence, according to an embodiment of the present 

•° invention, not only the appearance, but also the 
disappearance of logos are detected. 

As such, the present invention provides a method of 
sensing disappearance of the previously detected logos in 



6 



SAM2.0031 

noisy digital video signals. For example, when a video 
program starts, a short period of time is allowed to 
initially detect the existence and the shape and location 
of the logo within the incoming video frames. Once the 
logo is detected, a logo map is generated, and then a logo 
tracking process senses whether the logo remains in, or 
disappears from, the video frames. The logo map is 
generated according to the detected logo (shape and 
location) at the end of the initial logo detection period. 
Once generated, it is then applied to tracking the 
disappearance of the detected logo. If the logo moves or 
(partially) changes its intensity, color, pattern, etc., it 
will be sensed as having disappeared. 

A logo can disappear from an image either abruptly or 
gradually (i.e., fade off). For a gradually disappearing 
logo, a sensing method according to the present invention 
senses fading of the logo at an early stage, and then 
reserves a short period of time to allow the logo to 
gradually fade off until it disappears. After the logo has 
disappeared, another initial logo detection period begins 
and the logo detection and tracking steps repeat until the 
video program ends (FIG. 1) . 



SAM2.0031 



In one implementation, tracking and sensing 
disappearance of the detected logo is based on the logo 
map. The logo map can be viewed as a binary image, the 
same size as the image frame, wherein each pixel in the 
logo map corresponds to the pixel at the same location in 
the image frame. If a pixel value in the logo map is 1, 
the corresponding pixel in the image frame belongs to logo 
area; otherwise, if the pixel value in the logo map is 0, 
the corresponding pixel in the image frame belongs to the 
background video content. The logo map is generated by the 
logo detection module. Other logo detection methods can be 
utilized. 

In addition to the logo map, a reference frame is 
utilized for logo tracking. The reference frame is used to 
calculate the pixel-by-pixel difference for each incoming 
frame. In one example, according to the present invention, 
the last frame used in the initial logo detection phase is 
used as the reference frame. As such, an incoming video 
frame is scanned pixel by pixel. Based on the logo map, if 
a pixel belongs to the detected logo (i.e., is in the logo 
area) , the difference between that pixel and the 
corresponding pixel in the reference frame is calculated. 
Then the given noise mean is subtracted from the difference 
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and the obtained value is squared. Otherwise, if the pixel 
does not belong to the logo, it is bypassed. 

After at least a plurality of the pixels in the frame 
are so checked, the square of the (difference - noise mean) 
for all logo pixels are summed and averaged. Then the 
average is compared to the given noise level (represented 
by the standard deviation, i.e. STD) . If they match well 
(i.e., the difference between the said average and the 
given noise level (STD) is less than the threshold) , then 
the logo still remains in the current frame; otherwise, it 
has disappeared. The threshold is a pre-determined 
parameter for tolerating the measurement and computation 
errors . 

As such, a second order, stochastic character/measure 
<r d of the pixel intensity value differences is utilized for 
tracking and sensing if the logo disappears from the image 
frames. The standard deviation of the noise is also 
utilized in sensing the disappearance of previously 
detected logo when the digital video signal is noisy. 
Therefore, the present invention is very reliable and 
robust when the digital video signals contain noise, even 
at considerably high levels. 
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FIG. 1 is a diagramatic illustration of an example 
process 100 of detecting and tracking logos within video 
images in time, according to the present invention. When a 
video program comprising multiple video image frames begins 
at time 110, a short time period 120 is allowed to 
initially detect the existence, the shape and the location 
of a logo within initial video frames. Once the logo is 
detected at time 130, a logo map is generated, and then 
during a time period 140 a logo tracking mechanism senses 
whether the detected logo remains or disappears from 
subsequent video frames. 

FIG. 2 illustrates a flowchart of example steps of 
detecting and tracking logos within a sequence of video 
frames, according to an embodiment of the present 
invention. The video frames are first checked to determine 
if the end of the video program has been reached (step 
200) . If yes, the process ends. Otherwise, it is 
determined if the initial logo detection time period has 
expired by examining a flag that was initially set to ON, 
to indicate the beginning of the detection time period 
(step 210). If not (i.e., the initial logo detection time 
period has not expired) , the current video frame is passed 
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to the initial logo detection module to detect a logo 
therein (step 220) . 

After determining that the last of a plurality of 
video frames have been examined during the initial 
detection time period (step 230), a logo map is generated 
(step 240), the aforementioned flag is set to OFF (step 
250), and the process returns to step 200. If in step 210 
the current video frame is read in after the initial 
detection time period has ended, then that current video 
frame is passed to the logo tracking module (step 260) for 
sensing if the logo remains in, or disappeared from, the 
current video frame (step 270) . If the logo is not in the 
current video frame, then the initial detection flag is set 
back to ON (step 280) and the process returns to step 200 
so that staring with the next incoming video frame, the 
logo is re-detected and the logo map is regenerated 
accordingly. The above process repeats until the video 
program ends. More details of tracking the logo are 
discussed in following. 

FIG. 3 shows an example of the logo map 300 that is 
utilized in logo tracking. The logo map 300 can be viewed 
as a binary image of the same size as a video image frame. 
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In this binary logo map image 300, each pixel 310 has a 
binary value number (e.g., 0 or 1) . Each binary number 
indicates whether the corresponding pixel in the current 
video frame belongs to a logo area (e.g., binary value 
number 1) or not (e.g., binary value number 0). In this 
example, the logo symbol spatially marked by the binary 
numbers is "LOGO" . 

FIG. 4 illustrates the steps of an example pixel-by- 
pixel process of sensing (detecting or determining) if the 
logo remains in, or has disappeared from, the current video 
frame. The sensing process utilizes the logo map 300, the 
reference frame 305 and a given noise level <j Sf to track the 
logo for the current video frame. The process begins with 
determining if a pixel under examination is the last pixel 
in the video frame (step 400) . If not, then the logo map 
is examined to determine if the corresponding binary number 
in the logo map 300 indicates that this pixel is a logo 
pixel (step 410). If not, (i.e., the corresponding binary 
number is 0) , then that pixel is bypassed (step 420) and 
the process returns to step 400. Otherwise (i.e., the 
pixel belongs to the logo area) , the absolute difference 
between intensity of the pixel and the intensity of the 
corresponding pixel in the reference frame (with the same 
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row and column coordinates) is computed (step 430), 
according to the relation: 

d(i) = P c (i)-PrO), • (1) 
where p c (i) denotes the pixel intensity value of the 
i th pixel in the current video frame, p r (i) denotes the 
corresponding pixel intensity value in the reference frame, 
and d(i) is the difference of the two values. 

Then the mean of the noise signal is subtracted from 
the difference as d\i) = d(i)- fi s (step 435). Then in step 440 

the square of the absolute value of d' (i) is calculated and 
accumulated (from the first to the i th pixel) according to 
the relation: 

^ 2 (0 = Sko)| 2 |/(/) = l} 

(2) 

= £{dU)-M s \ 2 |/C0 = l} 

7=1 

where f(j) denotes the binary number of the j th pixel 
in the logo map. 

After all pixels in the current frame are examined, 
the summation of the squared differences (with noise mean 
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subtracted, i.e. |d' I) are averaged according to the 



relation: 



=irXk/)-^l 2 l/0") =1 ) 



(3) 



where N denotes the total number of pixels in the 
current frame, and M represents the total number of logo 
pixels. As such the stochastic measure cr d is obtained as: 



10 Based on the example definition of (opaque) logos in 

the present invention, an unfading logo should remain 
constant (e.g., in intensity, color, shape, pattern, 
location, etc.) from frame to frame along the temporal . 
axis. Thus, if p(i) is the intensity of a logo pixel i, 

15 then d(i) equals the noise s(i) for that pixel. 

In general, a natural video noise signal can be 
modeled by a random process with mean according to the 
relation: 

20 
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2>(o 

Ms ~ ~ i whenM -> co (4) 
M 

where M is the total number of noise samples. 
Therefore, the standard deviation (STD) of noise within the 
logo area can be expressed according to the relation: 



I>(0-//, 



M 



, whenM-^oo 



(5) 



The current normal resolution for an HDTV is about 
1280 by 720 pixels per image frame or higher. DVD 
resolution is generally 720 by 480, interlaced. Under 
those conditions, the total number of logo pixels is large 
enough to represent sufficient sample space of the 
stochastic process. Therefore, based on the above 
analysis, in step 450 (FIG. 4) the stochastic measurement 
(Od) : 



M 



M 



(6) 



is compared with the noise standard deviation <j s , 
according to relations: 
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I Cd - <y s 



< th? 



(7) 



wherein if | <x d - <J S \ < threshold th, then the logo 
remains in the current video frame; Otherwise, the logo has 
disappeared. Note that in the above relation (6), the 
term d(i) is based only logo pixels, and M is the total 
number of logo pixels. 

As such, the previously detected logo is tracked 
within digital video signals that may be noisy, by: 
calculating the stochastic measurement (<r d ) of the logo area 
by computing the standard deviation of logo pixel intensity 
difference, and sensing if a logo remains in a video frame 
or has disappeared (or starts to fade off) by comparing the 
a d of the logo with given noise signal levels measured by 
standard deviation. 

Referring to FIG. 5, in another aspect, such a logo 
detection and tracking method according to the present 
invention is implemented in a logo detection and system 
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500, comprising a logo detector 510, a logo map generator 
520, a logo tracker/sensor 530 and a logo processor 540. 
The logo detector 510, the logo map generator 520 and the 
logo tracker/sensor 530 in the example architectural block 
diagram of system 500 implement the example steps described 
above. Further, the logo processor 540 can be designed to 
process a video frame including a logo in a desired fashion 
(i.e., remove the logo, move the logo, etc.). Other 
implementations are possible. 

While this invention is susceptible of embodiments in 
many different forms, there are shown in the drawings and 
will herein be described in detail, preferred embodiments of 
the invention with the understanding that the present 
disclosure is to be considered as an exemplification of the 
principles of the invention and is not intended to limit the 
broad aspects of the invention to the embodiments 
illustrated. The aforementioned system 500 according to the 
present invention can be implemented in many ways, such as 
program instructions for execution by a processor, as logic 
circuits, as ASIC, as firmware, etc., as is known to those 
skilled in the art. Therefore, the present invention is not 
limited to the example embodiments described herein. 
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The present invention has been described in 
considerable detail with reference to certain preferred 
versions thereof; however, other versions are possible. 
Therefore, the spirit and scope of the appended claims 
should not be limited to the description of the preferred 
versions contained herein. 
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